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We investigate algorithms for reconstructing a convex body K 
in R" from noisy measurements of its support function or its bright- 
ness function in k directions iti , . . . , Uk- The key idea of these algo- 
rithms is to construct a convex polytope P^ whose support function 
(or brightness function) best approximates the given measurements 
in the directions ui,...,Uk (in the least squares sense). The mea- 
surement errors are assumed to be stochastically independent and 
Gaussian. 

It is shown that this procedure is (strongly) consistent, meaning 
that, almost surely, P^ tends to K in the Hausdorff metric as k — > oo. 
Here some mild assumptions on the sequence (m) of directions are 
needed. Using results from the theory of empirical processes, esti- 
mates of rates of convergence are derived, which are first obtained in 
the L2 metric and then transferred to the Hausdorff metric. Along 
the way, a new estimate is obtained for the metric entropy of the 
class of origin-symmetric zonoids contained in the unit ball. 

Similar results are obtained for the convergence of an algorithm 
that reconstructs an approximating measure to the directional mea- 
sure of a stationary fiber process from noisy measurements of its rose 
of intersections in k directions ui,...,Uk- Here the Dudley and Pro- 
horov metrics are used. The methods are linked to those employed 
for the support and brightness function algorithms via the fact that 
the rose of intersections is the support function of a projection body. 
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1. Introduction. The problem of reconstructing an unknown shape from 
a finite number of noisy measurements of its support function [giving the 
(signed) distances from some fixed reference point, usually taken to be the 
origin, to the support hyperplanes of the shape] has attracted much atten- 
tion. The nature of the measurements makes it natural to restrict attention 
to convex bodies. Prince and Willsky [27] used such data in computerized to- 
mography as a prior to improve performance, particularly when only limited 
data is available. Lele, Kulkarni and Willsky [21] applied support function 
measurements to target reconstruction from range-resolved and Doppler- 
resolved laser-radar data. The general approach in these papers is to fit a 
polygon or polyhedron to the data by a least squares procedure. In con- 
trast, Fisher, Hall, Turlach and Watson [8] use spline interpolation and the 
so-called von Mises kernel to fit a smooth curve to the data in the two- 
dimensional case. This method was taken up by Hall and Turlach [16] and 
Mammen, Marron, Turlach and Wand [22], the former dealing with convex 
bodies with corners and the latter giving an example to show that the al- 
gorithm of Fisher, Hall, Turlach and Watson [8] may fail for a given data 
set. Further applications and the three-dimensional case can be found in pa- 
pers by Gregor and Rannou [14], Ikehata and Ohe [18] and Karl, Kulkarni, 
Verghese and Willsky [19]. 

Despite all this work, the convergence of even the most straightforward 
of the reconstruction algorithms has apparently never been proved. In The- 
orem 6.1 below, we provide such a proof for an algorithm we call Algo- 
rithm NoisySupportLSQ, due to Prince and Willsky [27]. By convergence, 
we mean that, given a suitable sequence of directions, the estimators, con- 
vex polytopes, obtained by running the algorithm with noisy measurements 
taken in the first k directions in the sequence, converge in suitable metrics 
(the L/2 and Hausdorff metrics) to the unknown convex body as k tends to 
infinity. Suitable sequences of directions are those that are "evenly spread," 
only slightly more restrictive than the obviously necessary condition that 
the sequence be dense in the unit sphere. 

Moreover, by applying some beautiful and deep results from the theory 
of empirical processes, we are able to provide in Theorem 6.2 estimates of 
rates of convergence of the estimators to the unknown convex body. Some 
considerable technicalities are involved, and some extra conditions are re- 
quired, of which, however, only a rather stronger condition on the sequence 
of directions should be regarded as really essential. Convergence rates de- 
pend on the dimension of the unknown convex body; for example, for the 
L2 metric, the rate is of order /c~ 2 / 5 in the two-dimensional case, and A;" 1 / 3 
in the three-dimensional case. 

Analogous results are obtained for an algorithm, Algorithm NoisyBrightLSQ, 
essentially that proposed recently by Gardner and Milanfar [13], that con- 
structs an approximating convex polytope to an unknown origin-symmetric 



CONVERGENCE OF RECONSTRUCTION ALGORITHMS 



3 



convex body from a finite number of noisy measurements of its brightness 
function (giving the areas of the shadows of the body on hyperplanes). The 
very existence of such an algorithm is highly nontrivial, due to the extremely 
weak data; each measurement is a single scalar that provides no information 
at all about the shape of the shadow! Nevertheless, the algorithm has been 
successfully implemented, even in three dimensions. Here we are able to 
prove, for the first time, convergence (Theorem 7.2), with estimates of rates 
of convergence (Theorem 7.6) also for this algorithm. One technical device 
that aids in this endeavor is the so-called projection body, whose support 
function equals the brightness function of a given convex body. This allows 
some of our results on reconstruction from support functions to be trans- 
ferred to the new reconstruction problem. However, we require additional 
deep results on projection bodies (a subclass of the class of zonoids) from 
the theory of convex geometry due to Bourgain and Lindenstrauss [1] and 
Campi [4]. Examples of rates of convergence we obtain, for the Hausdorff 
metric, are of order /c -4 / 15 in the two-dimensional case and /c -1 / 30 in the 
three-dimensional case. 

Most of our results are actually much more informative in that they in- 
dicate also how the convergence depends on the noise level and the scaling 
of the input body. A discussion and the results of some Monte Carlo simu- 
lations can be found in Section 8. 

Many auxiliary results are obtained in the course of proving the conver- 
gence of these algorithms, but one is perhaps worth special mention. Roughly 
speaking, the results we employ from the theory of empirical processes give 
rates of convergence of least squares estimators to an unknown function in 
terms of the metric entropy of the class of functions involved. In obtaining 
our results on reconstruction from support functions, it turns out that we 
therefore need an estimate of the metric entropy of the class of compact 
convex subsets of the unit ball B in n-dimensional space, with the Haus- 
dorff metric. Luckily, the precise order of this, t~( n_1 )/ 2 for sufficiently small 
t > 0, was previously established by Bronshtein [3] (see Proposition 5.4; it 
is traditional to talk of e-entropy rather than i-entropy, but we require e 
for a different purpose in this paper). In the problem of reconstruction from 
brightness functions, however, we need to know the metric entropy of the 
class of origin-symmetric zonoids contained in B. As far as we know, this 
natural problem has not been addressed before. For n = 2, it is easy to see 
that the answer, i -1 / 2 , is unchanged, but in Theorem 7.3 we show that, for 
fixed n > 3 and any rj > 0, the f-entropy of this class is 0(t~ 2 ( n ~ 1 )/( n+2 )~ , 7) 
for sufficiently small t > 0. This is somewhat remarkable, since the t-entropy 
becomes 0(t~ 2 ) as n tends to infinity, in complete contrast to the case of 
general compact convex sets. The hard work behind Theorem 7.3 is done in 
the highly technical papers of Bourgain and Lindenstrauss [2] and Matousek 
[24] on the approximation of zonoids by zonotopes. 
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While most of the paper is devoted to reconstruction of convex bod- 
ies, Section 9 focuses on a problem from stereology, that of reconstruct- 
ing an unknown directional measure of a stationary fiber process from a 
finite number of noisy measurements of its rose of intersections. It turns 
out that the corresponding algorithm, Algorithm NoisyRoseLSQ, is very 
closely related to Algorithm NoisyBrightLSQ, due to the fact that the rose 
of intersections is the support function of a projection body. This fact 
was also used by Kiderlen [20], where an estimation method similar to 
Algorithm NoisyRoseLSQ was suggested and analyzed. Convergence of 
Algorithm NoisyRoseLSQ was proved by Mannle [23], but also follows easily 
from our earlier results (see Proposition 9.1). With suitable extra assump- 
tions, we can once again obtain estimates of rates of convergence of the ap- 
proximating measures to the unknown directional measure. These are first 
given for the Dudley metric in Theorem 9.4, but can easily be converted to 
rates for the Prohorov metric. For example, for the Prohorov metric, the 
rate is of order fc -1 / 20 in the three-dimensional case. 

2. Definitions, notation and preliminaries. As usual, denotes the 

unit sphere, B the unit ball, o the origin and || • || the norm in Euclidean n- 
space W 1 . It is assumed throughout that n > 2. A direction is a unit vector, 
that is, an element of S 1 " --1 . If u is a direction, then u 1 - is the (n — 1)- 
dimensional subspace orthogonal to u. If x,y G W 1 , then x ■ y is the inner 
product of x and y and [x,y] denotes the line segment with endpoints x and 

y- 

If A is a set, dim A is its dimension, that is, the dimension of its affine hull, 
and dA is its boundary. The notation for the usual (orthogonal) projection 
of A on a subspace S is A\S. A set is origin symmetric if it is centrally 
symmetric, with center at the origin. 

We write Vt for /c-dimensional Lebesgue measure in R n , where k = 1, . . . , n, 
and where we identify with fc-dimensional Hausdorff measure. If if is a 
/c-dimensional convex subset of M n , then V{K) is its volume Vk{K). Define 
K n = V(B). The notation dz will always mean dVk(z) for the appropriate 
k = 1, . . . , n. 

Let lC n be the family of nonempty compact convex subsets of R n . A set 
K G KL n is called a convex body if its interior is nonempty. If K G KL n , then 

Hk{x) = max{x • y:y G K}, 

for x G W 1 , is its support function and 

b K (u) = V(K\u ± ), 

for u G S n ~ l , its brightness function. Any K G KL n is uniquely determined 
by its support function. If K is an origin-symmetric convex body, it is 
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also uniquely determined by its brightness function. The Hausdorff distance 
S(K, L) between two sets K,L S fC n can be conveniently defined by 

S(K,L) = \\h K - Mloo- 

We shall also employ the L 2 distance S 2 (K,L) defined by 

S 2 (K,L) = \\h K -h L \\ 2 . 

By Proposition 2.3.1 of [15], there is a constant c = c(n) such that if K and 
L are contained in RB for some R > 0, then 

(1) S(K,L) <cR {n - 1)/in+1) 6 2 (K,L) 2 ^ n+1 \ 

which shows (together with a trivial inequality in the converse direction) 
that both metrics induce the same topology on K, n . 

A zonotope is a vector sum of finitely many line segments. A zonoid is the 
limit in the Hausdorff metric of zonotopes. The projection body of a convex 
body K in R n is the origin-symmetric convex body UK defined by 

hnK = ok- 

An introduction to the theory of projection bodies is provided by Gardner 
[10], Chapter 4. It turns out that projection bodies are precisely the n- 
dimensional origin-symmetric zonoids. For this reason, we shall denote the 
set of projection bodies in R n by Z n . 

The surface area measure S(K, •) of a convex body K is defined for Borel 
subsets E of S n ~ l by 

(2) S(K,E) = V n - l (g~ 1 (K,E)), 

where g~ l (K,E) is the set of points in dK at which there is an outer unit 
normal vector in E. The convex body P is a zonotope if and only if P = UK 
for some origin-symmetric convex poly tope K. In this case, S(K,-) is a sum 
of point masses, each located at one of the directions of the line segments 
whose sum is P and with weight equal to half the length of this line segment. 
This fact will be used in a reconstruction algorithm in Section 7. 

A fundamental result is Minkowski's existence theorem (see, e.g., [10], 
Theorem A. 3. 2), which says that a finite Borel measure /i in S 1 ™" 1 is the 
surface area measure of some convex body K in W 1 , unique up to translation, 
if and only if \x is not concentrated on any great sphere and 

/ udfj,(u) = o. 

The treatise of Schneider [28] is an excellent general reference for all of 
these topics. 

Let U = {u\, . . . ,Uk} C S" 1 " 1 . The nodes corresponding to U are defined 
as follows. The hyperplanes u^~, i = l,...,k, partition M n into a finite set of 
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polyhedral cones, which intersect S n ~ in a finite set of spherically convex 
regions. The nodes ±Vj 6 5 n_1 , j = 1, . . . , I, are the vertices of these regions. 
Thus, when n = 2, the nodes are simply the 2k unit vectors each of which 
is orthogonal to some Ui, i = 1, . . . , k. When n = 3, each Vj is of the form 
(uj x Ui')/\\ui x Ui'\\, where 1 < i < i! < k and U{ ^ ±Uj/. Thus, for n = 3, 
I < k(k — l)/2 and in general, I = 0{k n ~ l ). Campi, Colesanti and Gronchi 
[5] proved the following result. 

Proposition 2.1. Let K be a convex body inW 1 and let U = {u\, . . . , u/J C 
gn-i S p an f i Among all convex bodies with the same brightness function 
values as K in the directions in U , there is a unique origin- symmetric con- 
vex poly tope P, of maximal volume and with each of its facets orthogonal to 
one of the nodes corresponding to U. 

This implies that, for any projection body UK and any finite set of direc- 
tions U C S™ -1 , there is a zonotope Z with hz(u) = huxiu), for all u EU. 
Moreover, Z can be written as a sum of line segments, each parallel to some 
node corresponding to U. 

The following deep result was proved independently by Campi [4] (for 
n = 3) and Bourgain and Lindenstrauss [1] . The latter authors state their 
theorem in terms of a metric other than the Hausdorff metric, and make an 
additional assumption on the distance between the projection bodies. Groe- 
mer ([15], Theorem 5.5.7) presents the version below, and his proof yields 
the estimate of the constant in (4). This involves some tedious calculations 
(see www.ac.wwu.edu/~gardner; no attempt was made to obtain the opti- 
mal expression). In (4) and throughout the paper, the "big O" notation is 
used in the sense of "less than a constant multiple depending only on n." 

Proposition 2.2. Let K and L be origin- symmetric convex bodies in 
W 1 , n > 3, such that 



for some < ro < i?o- If < a < 2/(n(n + 4)), there is a constant c = 
c(a,n,ro, Rq) such that 



r B CK,LC R B 



(3) 



S(K,L) <cd 2 (IlK,UL) a . 



Moreover, if < a < 2/(n(n + 4)) is fixed, tq < 1 and Rg > 1, then 



(4) 



c = 0(r { 




CONVERGENCE OF RECONSTRUCTION ALGORITHMS 



7 



3. Some properties of sets and sequences of unit vectors. In this section 
we gather together some basic results on sets and sequences of unit vectors 
that will be useful in Sections 5 and 7. 

If {ui, . . . is a finite subset of S 12-1 , its spread A^ is defined by 

(5) Afe = max min \\u — uAl. 

ueS n - 1 i<i<fe 

For i = 1, . . . , k, let be the spherical Voronoi cell 

(6) Qi = {u 6 S 11 ^ 1 : \\u — Ui\\ < \\u — Uj\\ for all 1 < i,j < k] 
containing Uj. Then Ui=i ^« = S 11-1 , and we define 

(7) uj k = max V n -i(Qi). 

l<i<k 

By the definition of spread, {u±, . . . , Uk} is a A^-net in 5 n_1 , meaning 
that, for every vector u in S" 1-1 , there is an i E {l,...,k} such that u is 
within a distance A^ of u^. The existence of e-nets in S n ~ l with relatively 
few points is provided by the following well-known result. It can be proved 
by induction on n in a constructive way; see, for example, [13], Lemma 7.1. 

Proposition 3.1. For each e > and n>2, there is an e-net in S'^ 1 
containing 0{e l ~ n ) points. 

Now let (ui) be an infinite sequence in S™" 1 . We retain the notation A^ 
for the spread of the first k points in the sequence, and similarly for lo^- We 
need to consider some conditions on (m) that are stronger than denseness 
in S 71 ' 1 . To this end, for u £ 5 n_1 and < t < 2, let 

C t ( u ) = {veS n - 1 :\\u-v\\ <t} 

be the open spherical cap with center u and radius t. We call (ttj) evenly 
spread if for all < t < 2, there is a constant c = c(t) > and an N = N(t) 
such that 

(8) \{ Ul ,...,u k }nC t (u)\>ck, 

for all u £ S 71 " 1 and k > N. 

The following lemma provides relations between various properties of se- 
quences we need later. A discussion of how these properties relate to the 
well-known concept of a uniformly distributed sequence can be found in the 
Appendix of [11]. 

Lemma 3.2. Consider the following properties of a sequence (ui) in 

qn—l . 



(i) A fe = 0(fe- 1 /(«-i)). 
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(ii) uju = 0(k~ 1 ) and (v,i) is dense in S n ~ l . 

(iii) (ui) is evenly spread. 

(iv) (u^ is dense in S*"" 1 . 

Then (i) (ii) =4> (iii) =^ (iv) , and there are sequences with property (i) . 

Proof. Assume (i), and let k E N and i G {1, . . . , k}. Let Oj, 1 < i < k, 
be the Voronoi cells corresponding to the set {u±, . . . ,Uk} defined by (6). 
Note that Oj C C& k {ui) and hence, 

K-l(^) < V n -i(CA k (ui)) < V n -i(D k ( Ui )), 

where D k (ui) is the (n — 1) -dimensional ball in the tangent hyperplane 
to S" 1-1 at U{, obtained by the inverse spherical projection (with center 
o) of C& k (ui). If A k < y/2, then D k (ui) has center Ui and radius r k = 
tan(2arcsin(A^./2)). Therefore, 

uj k = max Vn-iiSU) < rr^n-i = O^ 1 ) = 0{k~ l ). 

l<i<k 

Since it is clear that (i) also implies that (ui) is dense in S n , (ii) holds. 

Suppose that (ii) holds. Fix < t < 2 and u £ S 1 ™" 1 . Cover S" 1 " 1 with 
finitely many open caps Cj = C t / e (vj), 1 < j < m. Since (u^ is dense in 
S 12-1 , there is an N = N(t) G N such that, for k > N, any of these caps 
contains at least one point of {u±, . . . , u k }. The cap C t / 3 (u) contains at least 
one Cj, and hence a point Ui with 1 < io < N. Note that iV does not depend 
on u. 

Fix k > N and let Oj, 1 < i < k, be the Voronoi cells corresponding to 
the set {u\, . . . , u k }. If f2« n int C t / 3 (u) 7^ 0, i 7^ io, there must be a point in 
C t / 3 (u) closer to ui than to ui . This implies ui E Ct(u). Consequently, 

int C t/3 (u) C (J{Oi : ^ n int C t/3 (u) / 0} C \J{SU : u t G C t («)}. 
Now (ii) implies that there is a c' = c'(t) such that 

V n -x(C t/3 (u)) < Vn-l^i) 
MiGCt(u) 

< uj k \{i:ui £ C t (u)}\ 
d 

< j\{ Ul ,...,u k }nc t (u)\. 

Since the left-hand side of the previous chain of inequalities does not depend 
on u, this yields (iii). That (iii) implies (iv) is clear. 

To obtain a sequence with property (i), observe that, by Proposition 3.1, 
there is a constant C such that, for each m G N, there is a set W m of at most 
C2 m ( n_1 ) unit vectors forming a 2 _m -net. Order the elements of each W m 
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in an arbitrary fashion, and let (it,) be the sequence obtained by forming 
one sequence from these finite sequences W\, W 2 and so on in that order. 
Let 

/ora(n-l) _ I \ 

N rn = C{2 n ~ x + 2 2 (™" 1 ) + • • • + 2 m ( n " 1 )) = C2™- 1 . 

\ 2 n 1 — 1 / 

Then for all k > N m , the points u±, . . . , u k form a 2 _m -net. 

Now suppose that k is the least integer such that the points ui,...,Uk 
have spread A^, where 

2" m < A k <2 1 ~ m . 

Then 

/nm(«-l) 1 \ /on— 1 a1- n i 

k < N m = C2 n ~ x ( , ~ y \ < C2 n - 

or 



2"-l _ 1 I \ 2 n - 1 - 1 



C2 2(n-1) □ 

Let (itj) be a sequence of vectors in 5 n . For application in Section 7, 
we need to consider properties of the "symmetrized" sequence 

(9) {u*) = (u 1 ,-u 1 ,u 2 ,-u 2 ,...). 
Let 

(10) At = max min min{]|ii — Ui\\, \\u — (— Ui)\\} 

iieS™- 1 l<i<k 

be the symmetrized spread of u±,...,Uk. Also, let u;*. be the maximum 
V^_i-measure of the 2k spherical Voronoi cells corresponding to the set 
{±ui,±u 2 ,...,±u k }. 

Following [20], page 14, we call (itj) asymptotically dense if 

liminf — \{u%, . . . , u k } n G\ > 0, 

fc— >oo K 

for all origin-symmetric open sets G ^ in S 1 ™" 1 . 

Lemma 3.3. Consider the following properties of a sequence (u,) m 



n— 1 . 



(i) A^ = 0(A;- 1 /(«-i)). 

(ii) u;*. = 0{k~ l ) and (it*) is dense in S"™ -1 . 

(iiia) (it*) is evenly spread. 

(iiib) (ui) is asymptotically dense. 
(iv) (it*) is dense in S™ -1 . 
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Then (i) =>• (ii) =>• (iiia) 44> (iiib) => (iv), and there are sequences with prop- 
erty (i) . 

Proof. The implications (i) => (ii) =>• (iiia) => (iv) are direct consequences 
of Lemma 3.2 and the definition of (u*). The existence statement also fol- 
lows from this lemma, as any sequence with A fe = O^-VCn-i)) satisfies 
A* =0(A;- 1 /(™-i)). 

That (iiia) implies (iiib) is trivial. To prove the converse, let Ct(u) be 
an open cap in S 1 " - " 1 of radius t, and cover the compact set <S n_1 with 
open caps C\, . . . ,C m of radius t/2. Then Cj C Cj(u) for some j. If (uj) 
is asymptotically dense, we can apply the definition of this property with 
G = Cj U (—Cj) to conclude that there are a constant d > and an N' such 
that 

\{u 1 ,..., Uk }n(C J u(-Cj))\>c'k 

for all k> N' and, hence, that 

\{±u 1 ,...,±u k }nC t (u)\>c'k 
for all k> N' . From this, it follows easily that (u*) is evenly spread. □ 

4. Metric entropy and convergence rates for least squares estimators. 

Let Q 7^ be a class of measurable real- valued functions defined on a subset 
E of M n . Suppose that x% £ E, i = 1, 2, . . . , are fixed, and let Xi, i = 1, 2, . . . , 
be independent random variables with mean zero and finite variance. If 
9o £ w e regard the quantities 

2/i = 5 , o(2;i) 

z = 1,2..., as measurements of the unknown function go- F° r k G N, any 
function g k & G satisfying 

(11) 3fc = argminV(y,; - g(xi)f 

see i=i 

is called a feast squares estimator for go with respect to Q, based on mea- 
surements at xi, . . . (Since g k depends on yi, . . . , y^, it also depends on 
the random variables X%, . . . ,X^, but this is not made explicit.) If k, Q and 
xi, . . . ,Xk are clear from the context, we shall simply refer to g k as a least 
squares estimator for go- I n the definition of X{ and yi are not needed 
for i > k, but later we shall take additional measurements into account in 
order to examine the asymptotic behavior of g k as k increases. In general, 
gk need not be unique and the existence of a least squares estimator has to 
be assumed. In the applications we have in mind, a least squares estimator 
always exists. To provide the necessary measurability for the background 
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theory to work, a suitable condition can be imposed on the class Q. Follow- 
ing [25], page 196, we call Q permissible if it is indexed by a set Y that is 
an analytic subset of a compact metric space, such that Q = {g(-,y),y £ Y}, 
and g(-, •) :K n x Y — ► M is C n ® £?(y)-measurable, where £ n is the class of 
Lebesgue measurable sets in R n and B(Y) is the class of Borel subsets of Y. 
The metric on Y will be important only insofar as it determines B(Y). 

Let (S, d) be a set 5 equipped with a pseudometric <i and let e > 0. A set 
U C £ is called an e-net if each point in 5 is within a d-distance at most e 
of some point in U. 

We can now define metric entropy, a valuable concept introduced by 
Kolmogorov. Metric entropy is often also called e-entropy, but we need to 
reserve the letter e for a different purpose. Accordingly, we define the t- 
covering number N(t,S,d) of (S, d) as the least cardinality of all t-nets. In 
other words, N(t, S, d) is the least number of balls of radius t with respect 
to d that cover S. Then H(t,S,d) = log N(t, S, d) is called the t-entropy of 
(S,d), and we can drop the argument d when there is no possibility of con- 
fusion. This notion will mainly be used for subsets of Q. For k 6 N, we define 
a pseudonorm | • \ k on Q by 




g^Q. 



Note that this pseudonorm depends on x\,. . . ,x k . For e > 0, let 

Gk{e,go) = {g £ G:\g-go\k < el- 
Then we denote by H(t,Qk{£, go)) the t-entropy of &k{£,go) with respect to 
the pseudometric generated by the pseudonorm \ -\k] again, this depends on 
Xi, . . . ,Xk- YiQ is a cone (i.e., Q = sQ for all s > 0), then 

(12) H(t, Q k (e, g )) = H(st, G k (se, sg )) = H(st, sQ k (e, g )), 

for any s > 0. This follows from the fact that the balls of radius t (with 
respect to | • \ k ) with centers gi, ... ,g m form a minimal cover of Gk(£,go) if 
and only if the balls of radius st with centers sgi, . . . , sg m form a minimal 
cover of Q k (se, sgo). A local entropy integral Jfc(e, G) can be defined for a > 
and < e < 2 6 a by 

(13) J k (e,g)=mzx\ [ £ H(t,G k (e, g )) 1/2 dt,e). 

Note that this integral depends on go> a an d x±, . . . ,x k , although this is not 
explicit in the notation. 

To state the principal technical result, a little more terminology is needed. 
The random variables Xi are called uniformly sub- Gaussian if there are 
constants A and r such that, for z = 1,2,..., we have 

(14) A 2 {E[e\ x *\ 2 l A2 ]-l)<T 2 . 
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Note that if is a normal iV(0, a 2 ) random variable for i = 1, 2, . . . , then 
this condition is satisfied when A = r = 2cr. 

The following result is due to van de Geer [32], Theorem 9.1 (see also [31]). 



Proposition 4.1. Let a > and let X it i = 1,2, . . . , be uniformly sub- 
Gaussian independent random variables satisfying (14), each with mean 
zero. Let Q be a permissible class of real-valued functions on a subset E 
of W 1 , let <7o £ Q, and let (xi) be a sequence in E. Let Jk(6,Q) be defined 
by (13), and suppose that is a function with ^f(e) > Jk{6,Q) for all k £ N 
and such that \&(e)/e 2 is decreasing for < e < 2 6 a. Then there is a constant 
c = c(A, t) such that, for any k £ N and any > vfe? > c^e^.), we 
have 

(15) Pr(| so - 9k\k > s k ) < ce~ k£l/c2 + ^ E ^ > ' 

/or any least squares estimator g^ of go with respect to Q based on measure- 
ments at xi, . . . ,Xfc. 



It is crucial that the constant c depends neither on a nor on k. In The- 
orem 9.1 of [32], the fact that c is independent of k is not explicitly stated 
and requires some explanation. In our notation, the proof of Theorem 9.1 
of [32] arrives at the inequality Vkek > 16C^(ek), where C is a constant 
independent of k. The assumptions and (13) yield 

VE>16C*^>16C^©>^, 

or \fk~Ek > 16C. This allows the finite sum on the last line of page 149 of [32] 
to be bounded above by a geometric series whose sum depends on k only 
in the required exponential form. (See the proof of Lemma 3.2 of [32] for a 
similar argument.) 

The following result is implicit in pages 187-188 of [32]. A proof is pro- 
vided for the convenience of the reader and because we need some details 
about the constants involved. 



Corollary 4.2. Suppose that the assumptions on the random variables 
Xi and class Q in Proposition 4.1 hold. For all fceN, let gk be a least squares 
estimator of go with respect to Q, based on measurements at xi,...,Xk- If 
there are positive constants a, to and M such that 

(16) H(t,g k (e ,g ))<M 2 t- a , 
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for all k G N, < t < to and &o = 2 13 / 2 t, then, almost surely, there are con- 
stants C = C(A,t, a) and N = N(A,T,a,tQ, M) such that 

r C r Af 3/(2+a) A .-l/(2+a) j t f a< 2, 

(17) |so-&|k< I Ck-^logk, if 01 = 2, 

for k > N. 

Proof. Let J k (e,G) be defined by (13) with a = y/2~T. We may sup- 
pose that r > and therefore that a > 0. As H(t,Qk(e,go)) is an increas- 
ing function of e (with t fixed), (16) holds when eo is replaced by any 
0<e<2 6 a = e - 

Consider first the case a < 2 and let < e < 2 6 a. For < e < to, we have 



f H (t,g k (e,g )) 1/2 dt<^-(e 

Je 2 /<2^a) 2 - a \ 



/e 2 /(2 6 a) 2 — a\ \2 6 a / 

As H(t,g k (e, go)) is a decreasing function of t (with e fixed), e > to implies 



f H(t,g k ( £ ,g )) 1/2 dt 

Je 2 /(2 (i a) 

f° H(t,g k (e,g )) 1/2 dt+ f £ H(t,g k (e,g )) 1/2 dt 

Je 2 /(2<^a) J to 



2 /(2 6 «) Jt 

<^-tl a/2 + H(to,g k (e,g )) 1/2 (e-t ). 
2 — a 



Let 
(18) 



{^ el " tt/2 . e }' ifO<,<to, 
{^- a/2 + AfC/ 2 (e -t ), e }, ife>*d. 



Then VP(e) > J(e,Q) and by (18), ^{e)/e 2 is a decreasing function of e > 0. 
Suppose that c> and let e fc = A-ik" 1 ^ 2 ^ . If both 

and 

— {(ir^tr 

hold, then one can check that e k < to and (using this also) that Vksi > 
c^(efc). As noted by van de Geer [32], page 150, (14) implies that 
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Thus, (15) yields 

(21) Pr(| 50 - 9k\k > A 1 k- 1 ^) < ce-^ aK2+a) " 2 + e -^/(^ a ), 

provided (19) and (20) hold. The sum over k of the right-hand side of (21) 
converges, so by the Borel-Cantelli lemma we have, almost surely, 



1 5o - 9k 



k < Ark- 1 '^ = aM 2 /( 2 + a )rV( 2 + Q ), 



say, for sufficiently large k. Therefore, (17) is true when a < 2. 

The argument when a > 2 is similar; we omit the details. If a > 2, we 
take 



2M / e 2 N 1 ""/ 2 
max^ olT^ - ' e n ifO<e<to) 



a- 2 V2 6 a / 

{^2 (i) 1 "^ 2 + Mt °" a/2(£ " t0) ' £ }' if ' " *" 

and £fc = A2k~ l / 2a for a suitable constant A<l- If a = 2, we can take 

^, v = f max{M(log(2 6 a) - loge), e}, if < e < to, 

{) lmax{M(log(2 6 a)-logt + (e-t )/t ),e}, ife>t , 

and £k = A3fc _1//4 logfc for a suitable constant A3. In both cases it can be 
checked that Sk < to an d then that vfce| > c x I / (e/t) when is sufficiently 
large. (The case a = 2 is qualitatively different, as A3 can be chosen inde- 
pendent of M.) □ 



max< 



5. Least squares estimation of support functions. Suppose that K is an 
unknown convex body in W 1 , and (itj) is a sequence in S n . For E N, the 
support function hx of X is measured at u\ , 112, ■ ■ ■ , Uk- The measurements 

(22) y i = h K {u i ) + X i , 

i = l,2,...,k, are noisy, the Xi's being independent random variables with 
zero mean and finite variance. We want to find a convex body with the 
property that its support function values at u±, . . . ,Uk best approximate the 
measurements y\, . . . , y\~. In order to apply the results of the previous section, 
we let E = S" 1 " 1 and 

G = {h L :L£lC n }, 
the class of support functions, throughout this section. 



Lemma 5.1. The class Q is permissible. 
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Proof. Referring to the above definition of the term "permissible," the 
index set Y = K7 1 is a subset of the family T n of all closed subsets of R n . 
The latter, endowed with the hit-and-miss topology, is a compact metrizable 
space; see, for example, [29], Satz 1.1.1. By Satz 1.3.2 of [29], Y is a Borel 
set in F n , so it is analytic in T n . Although the induced topology on Y 
as a subset of T n is coarser than the topology induced by the Hausdorff 
metric, the respective families of Borel sets coincide; see [29], Satz 1.3.2. 
The mapping (K,u) \— > hx{u) is continuous with respect to both topologies, 
so the parametrization mapping is Borel measurable. □ 

Fix k £ N and K £ IC n . In accordance with the notation of the previous 
section [see (11)], we let (hx) k be a least squares estimator for hx with 
respect to Q based on measurements at u\, . . . , u k , so that hx now plays 
the role of the function g$. As Q is a closed cone in the usual Banach space 
of continuous functions on the sphere [and the objective function in (11) 
is continuous on this space], a least squares estimator always exists. For 
h: S" 1 " 1 — > M, the pseudonorm \h\ k is now given by 



The following lemma provides an upper bound for the L<i distance be- 
tween two convex bodies L and M contained in a ball SB in terms of the 
pseudometric — h,M\k- 

Lemma 5.2. Let S > and let L and M be convex bodies in W 1 contained 
in SB . Let {u\, . . . ,Uk} be a subset of S™" 1 . Then 



where and uj^ are defined by (5) and (7), respectively. 

Proof. As in Section 3, denote the Voronoi cells corresponding to 
{ui, . . . ,Uk} by Qi, 1 < i < k. If u G Oj, we have ||tt — Ui\\ < and hence, 

h L (u) < h L (ui) + h L (u - Ui) 



(23) 




(24) 



S 2 (L,M)<(ku k ) 



/2 (\h L -h M \ k + 2A k S), 




Similarly, 



hM{ui) < h M (u) + h M (ui -u)< h M (u) + A k S. 



Therefore 



h L (u) - h M (u) < h L (ui) - h M (ui) + 2A fc S', 
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and interchanging L and M, we obtain 

\h L (u) - h M (u)\ < \h L (ui) - h M (ui)\ + 2A k S. 

Therefore, 

5 2 (L,M) 2 =[ {h L (u)-h M {u)fdu 

<V I (\h L (ui)-hM(ui)\ + 2A k S) 2 du 
i=i J ^ 

k 

< u k ^2(\h L (ui) - h M (ui)\ + 2A k S) 2 

i=l 

/ / k \ V 2 / k \ V 2 \ 



= /cu; fc (|/i L -/iA/|fc + 2A fc 5) 2 . □ 

We shall also need the next lemma, which under the assumption K C 
RB and a mild condition on the sequence (uj) yields the radius of a ball 
containing L in terms of the pseudometric | hx - h L \ k . 

Lemma 5.3. Let K and L be convex bodies in W 1 ' . Suppose that K C RB 
for some R>0, and that (m) is an evenly spread sequence in S" 1 " 1 . Then 
there are constants Cq = Co((uj)) > and Nq = No((ui)) G N such that 

Lc{C \h K -h L \ k + 2R)B, 

for all k>N . 

Proof. Fix k and choose x k G L, where we may assume that ||ajfc|| > 
2R since otherwise L C 2RB. Then hi,(u) > x k ■ u for all u G S n ~ l . Let 
Vk = ^fc/H^fcll- Choose to > small enough that, for each u G S" 1-1 and any 
v,w G Ct (u), we have v • w > 1/2. (Of course, to does not depend on fe.) If 
Uj G C to (v k ), then 



Therefore, 



- hz,(«t)| >x k -Ui-R> — R > 0. 



WieCi (« fc ) 

>^M- R ^\{ Ul ,..., Uk }nc t0 (v k )\ 
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for some c> and all k> N, say, because (uj) is evenly spread. [Note that 
c and N depend only on (itj).] From this, we obtain 

\\x k \\ < 2\^=\h K 
for k> N, and the result follows. □ 

The following result is due to Bronshtein [3] . His definition of entropy uses 
log 2 instead of the natural logarithm, requiring an extra constant factor in 
the lower bound. 

Proposition 5.4. Let IC n (B) denote the space of compact convex sub- 
sets of the unit ball B in W 1 , endowed with the Hausdorff metric. Then for 
0<t< 10~ 12 /{n - 1), the t-entropy H(t,K, n (B)) ofK n {B) satisfies 



(25) <H{tX n {B)) < (bg^ioV/V^ 

[n 1) 



Let e and t be positive numbers and let k G N. As before, let 
G k (e, h K ) = {h L eQ: \h K - h L \ k < e}, 

and let 

H(t,g k (e,h K ))=S(t,g k (e,h K ),\'\k) 

be the t-entropy of Q k (e, hx) with respect to the pseudometric generated by 
I ' Ifc- 

Corollary 5.5. Let (ui) be an evenly spread sequence in S" 1-1 and let 
K be a convex body in W 1 with K C RB for some R > 0. Then there are 
constants t\ = t\(n, (uj)) and C\ = Ci(n, (iti)) such that 

(26) H(t, g k (e, h K )) < CxR^lH-^l 2 , 

for all ken, 0<e<R and0<t< Rti . 

Proof. We first make the following claim: There is a constant so = 
so(n, (ui)) > such that, for all k € N and hi, E G k (£,hK), there is an L' £ 
(R/so)fC n (B) with hi>(ui) = hi(ui), for i = 1, . . . , k. 

The claim will be proved later. Assuming it is true, we observe that if 
hi G (so/ ' R)Q k {e,hK), then there is an V G IC n (B) such that \hi — /imU = 
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\hu ~ h>M\k f° r an Y compact convex set M in W 1 . It follows from this and 
(12) with s = s /R that 

H(t, G k (e, h K )) = H(s t/R, (s /R)g k (e, h K )) 

<H(s t/R,{h L ,:L'elC n (B)},\-\ k ). 

Since 

\h>L ~ h M \k < \\hz ~ h M \\oo = 5(L,M), 

for any two compact convex subsets L and M in R n , we have 

H(t, Q k (e, h K )) < H(s t/R, {h v : U G K. n (B)}, \ ■ \ k ) < H(s t/R, K n {B)). 

Now (26) is an immediate consequence of (25) if we put h = 2 • W~ 12 /((n - 
l)s ) and d = (lo g 12)10 6 n 5 / 2 (2s ) (n " 1)/2 . 

It remains to prove the claim. Let hi G Q k {£^hx)- By Lemma 5.3, there 
are constants Cq = Co(( u i)) and Nq = No((iii)) such that if k > Nq, then 

(27) L C (C e + 2R)B c (Co + 2)RB. 

For such k, we let L' = L. Now let k < Nq. Since hi, G ^R")> we have 

(28) |M«i)| 2 < k\h L \ 2 k < N (e + |/^| fc ) 2 < 4N R 2 , 

for i = 1, . . . , k. Let / C {1, . . . , iVo} be nonempty, and consider the continu- 
ous function fj on S" 1-1 defined by 

fl( u ) =J2\ u ' Ui \- 
iel 

For u in the span of {ui :i 6 /}, fi(u) > 0. Therefore, we can choose ao = 
ao(ra, (ui)) > such that, for any such I and u in the span of {u{ :i £ I}, 
fl(u) > a . 

Suppose that {u±, . . . ,u k } spans W 1 . The polyhedron P = f]^ =1 {x G W 1 : 
x ■ Ui < hi(ui)} satisfies hp(ui) = hi{ui) for i = 1, ...,k, but may be un- 
bounded. Let L' = convjxi, . . . , x m }, where x±,...,x m are the vertices of 
P. Then L' is bounded and satisfies h,L'{ui) = hi{ui) for i = 1, . . . , k. Any 
vertex Xj of P is an intersection of n hyperplanes with linearly independent 
normals u^, . . . ,Ui n , say. Using (28) with L replaced by L' , we obtain, for 
any Xj ^ o, 



IkjIK < jj — ^-pr • u ip =^2\xj ■ u ip \ < h L '(ui p ) < 2h^/NqR. 

p=l " 3" p=l p=l 

Thus, L' C (2n*/No/a )RB. 

If the span of {u\, . . . ,u k } is a proper subspace 5 of IR n , the above ar- 
gument can be applied to L\S regarded as a compact convex subset of 5 
to obtain the same inclusion. In view of (27), which holds for all k > Nq 
with L replaced by L', we conclude that L' C (R/sq)B for all fceN, where 
sq = min{l/(Cb + 2), ao/(2ny/~No )} depends only on n and (ui). □ 
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Theorem 5.6. Let (n,,) be an evenly spread sequence in S n ~ l and let Xi, 
i = 1, 2, . . . , be uniformly sub-Gaussian independent random variables satis- 
fying (14) , each with mean zero. Let K be a convex body in M. n with K C RB, 
where R > 2 13 / 2 r, and for k G N, let (hx)k be a least squares estimator ofhx 
with respect to Q , based on measurements at u±, . . . ,Uk- Then, almost surely, 
there are constants C2 = C2(A,r,n) and N2 = N2(A,r,n,R, (ui)) such that 

_ f C 2 # (re-1)/(n+3) )r 2/(re+3) , if n = 2,3,4, 

(29) \hK-(h K )k\k<\c 2 k- 1 / 4 logk, ifn = 5, 

{c 2 R 1/2 k- 1 ^ n " 1 \ ifn>6, 

for k > N 2 . 

Proof. Let eo = 2 13 / 2 r. Since < £0 < R, Corollary 5.5 yields 

(30) H(t,G k (e ,h K )) < di?^- 1 )/ 2 *-^- 1 )/ 2 , 

for k G N and < t < Rt±. By (30), we may apply Corollary 4.2, with 
a = (n — l)/2, to = Rti and 

M 2 = C X R^I 2 , 

to conclude that (17) holds, almost surely, with M as above and C = 
C(A,T,a) = C 2 (A,T,n) and N = N(A, t, a, t , M) = N 2 (A, r, n, R, (m)). □ 

COROLLARY 5.7. Let (ui) be an evenly spread sequence in S*"" 1 and 
let Xi, i = 1,2,..., be independent N(0,o~ 2 ) random variables. Let K be a 
convex body in W 1 with K C RB, where R > c 15 / 2 , and for k G N, let (hx)k 
be a least squares estimator of hx with respect to Q, based on measurements 
at U\ , . . . , Uf. . Then, almost surely, there are constants C3 = C3 (re) and N3 = 
N3(a,n,R,(ui)) such that 

\h K ~ {h K )k\k < \ C^akT 1 ^ log k, 

lc 3 a 1 / 2 J Ri/2 A .-i/(n-i) ) 

(31) 

for k > N 3 . 

Proof. As was noted earlier, we may take A = t = 2a in Theorem 5.6 
and conclude that if K C RB and R > a 15 / 2 , then, almost surely, the least 
squares estimators (hK)k for hx with respect to Q satisfy (29), where the 
dependence of C2 and ^2 on A and r is replaced by dependence on a. 
Instead we now use scaled measurements 



i/re = 2,3,4, 
ifn = b, 
if re > 6, 



Xyi = Xh K {ui) + XXi, 
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with some A > 0, to estimatejthe support function h\K = Xhjc of the scaled 
convex body XK. Then \(fiK)k is a least squares estimator for h\K- Also, 
XXi, i = 1,2, ... , are independent normal iV(0, (Act) 2 ) random variables. Re- 
placing K, R and a by XK, XR and Act, respectively, we conclude that, 
almost surely, there are constants cq = co(Xa, n) and no = no(Xa, n, XR, (v,i)) 
such that 

(32) \Xh K - X(h^) k \ k < co(XR) K f n (k), 

for k>riQ, where R b " and f n (k) are the functions of R and k, respectively, 
in (29). When A = 1/a, (32) becomes 

(33) \h K - (Q fc | fc < C- i a l - K R K f n {k), 

where C3 = 6*3(71) and k > N3 = Ns(a,n,R,(ui)). Substituting b n and f n 
from (29) into (33), we arrive at (31). □ 

6. Convergence of the Prince Willsky algorithm. Let u\ , . . . , Uf. be fixed 
vectors in S^" 1 whose positive hull is M. n . We say that the nonnegative real 
numbers h\,...,h^ are consistent if there is a compact convex set L in W l 
such that hi(ui) = hi, i = 1, . . . ,k. If hi, . . . , hf. are consistent, there will 
be many such sets L; let P(h±, . . . , h k ) denote the one that is the polytope 
defined by 

k 

(34) P(h 1 ,...,h k ) = f]{xeR n :x-u i <h i }. 

i=l 

For n = 2 and vectors u\,. . . ,u k equally spaced in S 1 , the following algo- 
rithm was proposed and implemented by Prince and Willsky [27]. 

Algorithm NoisySupportLSQ. 

Input: Natural numbers n > 2 and k > n + 1; vectors ui G S n ~ l , i = 
l,...,k, whose positive hull is W 1 ; noisy support function measurements 

yi = h K (ui) + Xi, 

i = 1, . . . , k, of an unknown convex body K in W 1 , where the Xi's are inde- 
pendent ./V(0,<7 2 ) random variables. 

Task: Construct a convex polytope P k in W 1 that approximates K, with 
facet outer normals belonging to the set {uj : i = 1, . . . , k}. 

Action: Solve the following constrained linear least squares problem (LLS1): 

k 

(35) min V(y;-ft,;) 2 , 

' ' * i=l 

(36) subject to hi, . . . , h k are consistent. 

Let hi, ■ ■ ■ ,h k be a solution of (LLS1) and let P k = P(hi, . . . , h^)- □ 
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Naturally any implementation of Algorithm NoisySupportLSQ involves 
making explicit the constraint (36). Although we do not need to address this 
problem for our purposes, a few remarks are appropriate. For n = 2, this was 
done by Prince and Willsky [27] for vectors ui, . . . , life equally spaced in S , 
and by Lele, Kulkarni and Willsky [21] for arbitrary vectors u±, . . . by 
means of an inequality constraint of the form Ah < 0, where h = (hi, . . . , h^) 
and A is a certain matrix. For general n, this is more difficult and was stud- 
ied by Karl, Kulkarni, Verghese and Willsky [19]. (In these papers there 
is no mention of Rademacher's condition for consistency when n = 2, or of 
Firey's extension (see [28], page 47) of Rademacher's condition to n > 2.) 
The authors of [19] did not implement the algorithm for n > 3; an imple- 
mentation for n = 3 and certain special sets of directions was carried out by 
Gregor and Rannou [14]. 

If the positive hull of {u±, . . . ,Uk} is not M n , then (34) could still be 
considered as output of the Algorithm NoisySupportLSQ, if consistency of 
hi, ■ ■ ■ is extended to closed convex sets which may be unbounded. We 
choose not to do this, however. Indeed, if (ui) is a dense sequence of vectors 
in 5™ _1 , then, for sufficiently large k, the positive hull of m, . . . ,u^ is R n and 
in this case, Algorithm NoisySupportLSQ produces a polytope Py. as output. 
We now establish conditions under which P^ converges, almost surely, to K 
as k — > co. Of course, the denseness of (ui) is a necessary condition for such 
convergence. 

The following theorem establishes the strong consistency of Algorithm 
NoisySupportLSQ when (m) is evenly spread. 

Theorem 6.1. Let K be a convex body in M. n and let (ui) be an evenly 
spread sequence in S*™ -1 . If Pk is an output from Algorithm NoisySupportLSQ 
as stated above, then, almost surely, 

lim S(K,P k ) = 0. 

k—yoo 

Proof. Theorem 5.6 and (hK)k = hp k imply that, almost surely, we 
have 

(37) \im\h K -h p \ k = U. 

Fix a realization for which (37) holds. 

By Lemma 5.3, there is an S > such that Pj. C SB for all k. According 
to Blaschke's selection theorem, the set {Pi,p2,. . .} is relatively compact 
in the space of convex bodies in W 1 with the Hausdorff metric. To prove 
limfc^oo Pk = K, it is therefore enough to show that K is the only accumu- 
lation point of (Pk)- 



22 



R. J. GARDNER, M. KIDERLEN AND P. MILANFAR 



Let K be an arbitrary accumulation point of this sequence. Then a sub- 
sequence of (hp ) converges uniformly to hg- This and (37) can be applied 
to the right-hand side of 

\h>K ~ h^\ k < \h K - hp k \ k + \hp k - h k \ k 

to show that a subsequence (\Hk — h k \ k ') converges to 0. For each k' in this 
subsequence, 

\hx ~ h k \ k > = \\h K - h k \\ L2 ^ k ,) 

is the Z/2 norm of hx — h k with respect to the probability measure \i k i that 
assigns a mass 1/k' to each of the points u\, . . . ,u k /. As the set of probability 
measures in S n ~ l is weakly compact, there is a subsequence (/ifc") of (ny) 
that converges weakly to a probability measure jjL. Using the continuity of 
support functions, we conclude that 

We claim that, since (ui) is evenly spread, the support of fi is S" 1-1 ; this 
will then imply hx = hj> and, hence, K = K. To prove the claim, suppose 
that G is a nonempty open set in 5 n_1 such that n(G) = 0. Choose an open 
cap Ct(u) cG, t > 0, and a nonnegative continuous real- valued function / 
on 5" n_1 with support contained in G and such that / > 1 on Ct(u). Then 
the fact that (v,i) is evenly spread implies that 

0<lim inf / t c {v \ (v) dfi k (v) < lim / f(v)dfi k (v) 

= / f(v)dfx(v)<\\f\\ oof ,(G) = 0, 

where lo t (u) denotes the characteristic function of Ct(u). This contradiction 
completes the proof. □ 

The conclusion of the following theorem is stronger than that of Theo- 
rem 6.1 since it provides convergence rates. However, the hypothesis on the 
sequence (ui) is also stronger; see Lemma 3.2, which also guarantees the 
existence of suitable sequences (ui). 

Theorem 6.2. Let a > and let K be a convex body in M. n such that 
K C RB for some R > 2 15 / 2 cr. Let (m) be a sequence in S 1 ™ -1 with A k = 
0(k~ 1 ^ n ~^'). If P k is an output from Algorithm Noisy SupportLSQ as stated 
above, then, almost surely, there are constants C4 = C^(n, (ui)) and N4 = 
N4(o~,n,R,(ui)) such that 

f C 4CT 4/("+3) i j(n-l)/(n+3) fc -2/(n+3) j ifn= 3^ 

(38) 5 2 (K,P k ) < I C 4 ak-y 4 logk, ifn = 5, 

[c 4 (R+(aR) 1 / 2 )k~ 1 ^ n - 1 \ ifn>6, 
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for k>N 4 . 

Also, there are constants C5 = Cs(n, (v,i)) and N§ = N^(a,n, R, (iti)) such 
that 

C . 5CT 8/((n+l)(n+3)) i? (n-l)(n+5)/((n+l)(n+3)) 

xr 4/((n+l)(n+3)) ] ifn = 2,3,4, 

Cgci 1 / 3 i? 2 / 3 AT 1 / 12 (log k) 1 / 3 , ifn = 5, 

C 5 (R + o- 1 /(n+i)/2n/('H-i))Jb-2/(»* 2 -i) j if n > 6, 

for k > N 5 . 

Proof. By Lemma 5.3, we can apply Lemma 5.2 with L = K, M = 
and S = Co | Hk ~ hp k \k + 2JF2 to obtain 

(40) A) < (&u; fc ) 1/2 (4A fcj R + (2A fc C + l)\h K - hpj k ), 

for all k > Nq. By Lemma 3.2, kujk = 0(1) and we also have (hfc)k = hp ■ The 
various estimates for ^(^-Pfc) now follow from the corresponding estimates 
for \hx — {hK)k\k hi Corollary 5.7. 

To obtain the estimates for 6(K, we combine those just found and 
the relation (1) that yields 

S(K, P fc ) < c5 (n ~ 1)/(n+1) <5 2 (K, P fc ) 2/(n+1) , 
where S = Co\hx — hp |& + 2i?, for all /c > A^o- □ 

7. Reconstruction from brightness function measurements. Suppose that 
K is an unknown origin-symmetric convex body in M n , and (uj) is a sequence 
of directions in S n ~ l . For fe £ N, the brightness function bx of .fT is measured 
at ui,U2, ■ ■ ■ ,"Ufe. The measurements 

(41) y< = M«i)+- x 'i ) 

i = 1, 2, . . . , k, are noisy, the Xj's being independent random variables with 
zero mean and finite variance. We want to find an origin-symmetric convex 
body with the property that its brightness function values at u\ , . . . , best 
approximate the measurements y\ , . . . , y\.- 

The following algorithm was proposed by Gardner and Milanfar [12]. Since 
it is convenient for us to describe it in somewhat different language, we briefly 
explain how it works in the case of exact measurements, a situation ana- 
lyzed in detail by Gardner and Milanfar [13] . The algorithm proceeds in two 
phases, motivated by the connection between zonoids, projection bodies and 
surface area measures outlined in Section 2. In the first phase, a constrained 
least squares problem is solved to find a zonotope Z with hziui) = bxiui), 
i = 1, . . . , k. This zonotope is the projection body of a polytope whose surface 
area measure can easily be calculated from Z. The second phase reconstructs 
the polytope from this known surface area measure. 



(39) 5(K,P k )< 



24 



R. J. GARDNER, M. KIDERLEN AND P. MILANFAR 



Algorithm NoisyBrightLSQ. 

Input: Natural numbers n>2 and k; vectors u% S S™ -1 , % = 1, . . . , k, that 
span M n ; noisy brightness function measurements 

yi = b K (ui) +Xi, 

i = 1, . . . , k, of an unknown origin-symmetric convex body K in IR n , where 
the XiS are independent normal N(0,a 2 ) random variables. 

Task: Construct a convex polytope Qk in M n that approximates K. 

Action: 

Phase I: Find a zonotope G 2 n that solves the following least squares 
problem: 

k 

(42) minJT(y*-M^)) 2 - 

Calculate the (finitely supported) surface area measure S(Qk, •) of the origin- 
symmetric polytope Qk satisfying 

(43) Z k = UQ k . 

Phase II: Reconstruct Qk from S(Qk,-) (or directly from Zk, if possible). 

□ 

It was observed by Gardner and Milanfar [13] that the remark after Propo- 
sition 2.1 can be used in Phase I; this shows that a zonotope Zk solving (42) 
exists. Moreover, as Zk can be assumed to be a sum of line segments, each 
parallel to a node corresponding to U = {u±, . . . , u k }, only the length of these 
line segments has to be determined. [Note, however, that this restriction on 
the direction of the line segments is not required in (42).] This turns (42) 
into a finite-dimensional quadratic program which can be solved using stan- 
dard software. When n = 2, Phase II is simple (see [13], page 284, but note 
also the statistically improved method proposed by Poonawala, Milanfar 
and Gardner [26]). For n > 3, Phase II is highly nontrivial, but can be per- 
formed by means of the previously known algorithm MinkData (see [13] for 
references) . 

When the brightness function measurements are exact, it was proved by 
Gardner and Milanfar ([13], Theorem 6.1) that if (ui) is dense in S n_1 , then 
the outputs Qk [corresponding to the first k directions in (itj)] converge to 
K, as k — > oo. For a convergence proof that applies to noisy measurements, 
we can apply our results from Section 5. We begin with a suitable form of 
Lemma 5.3. Recall definition (9) of the symmetrized sequence (it*). 

Lemma 7.1. Let K and L be origin- symmetric convex bodies in W 1 . 
Suppose that K C RB for some R > 0, and that (uj) is a sequence in S" 1-1 
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such that (u*) is evenly spread. Then there are constants Cq = Cq ((itj)) > 
and iV * = N$((ui)) G N suc/j i/tai 

Lc(C *|/i x -/i L | fc + 2 J R) J B, 

/or allk>N$. 

Proof. This follows easily from Lemma 5.3, if (itj) and are replaced 
by (it*) and 2fc, respectively, and 

j 2fc 

2^S(^K) ~ MO) 2 = I for - foil 

i=l 

is taken into account. □ 

The next theorem gives the strong consistency of Algorithm NoisyBrightLSQ 
when (u*) is evenly spread. 

Theorem 7.2. Let K be a convex body in W 1 and let (uj) be a se- 
quence in S n ~ l such that (it*) is evenly spread. If Qk is an output from 
Algorithm NoisyBrightLSQ as stated above, then, almost surely, 

(44) lim S(K,Q k ) = 0. 

fc— »oo 

PROOF. Choose < r < R such that rB C K C RB. Then U(rB) C 
ILK C !!(#£), so 

(45) sB C ILK C £B, 

where s = K n -ir n ~ 1 and t = K^-ii?™" 1 . Theorem 5.6 and (hjiK)k = ^ fc ™" 
ply that, almost surely, we have 

(46) lim \huK ~ h% L = 0. 

Fix a realization for which (46) holds. 

By (45), (46) and Lemma 7.1 with K, L and R replaced by UK, Z k and 
Kfi—iR" 1-1 , respectively, there is an S > such that Z k C SB holds for all k. 
We can now apply Blaschke's selection theorem and the argument used in 
the proof of Theorem 6.1 to conclude that 

(47) lim S(UK,Z k ) = 0, 

fc— >oo 

as (u*) is evenly spread in 

When n = 2, it is easy to see that UK and HQk are rotations about the 
origin by ir/2 of 2K and 2Qfc, respectively. (See, e.g., [10], Theorem 4.1.4.) 
Therefore, (44) follows immediately from (47). 
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Suppose that n > 3. By (45) and (47), we have 

(48) S -BdZ k = UQ k C |ifl, 

for sufficiently large k. (Note that the fact that Z k is n-dimensional for suffi- 
ciently large k guarantees the existence of Qk-) Exactly the same argument 
as in the proof of Lemma 4.2 of [13] [beginning with formula (16) in that 
paper] leads from (48) to 

(49) r B C Q k C R B, 
for sufficiently large k, where 

3riK n /Sy^™" 1 ) R n , Kn-ir"" 1 



(50) Rq = - T and rn — 



Since rB C K C RB implies r^B C K C i?o-B, we can apply (47) and Propo- 
sition 2.2 with L = Qk to obtain (44). □ 



The results from Section 5 also give rates of convergence. However, we are 
able to do better, at least for 3 < n < 5, by replacing the class of regression 
functions by the smaller family 

g = {h z -.zez n }. 

Note that this class is permissible, since it is easy to check that Z n is a Borcl 
set in K. n . 

In the plane, the class Z 2 (B) of origin-symmetric zonoids contained in 
B is just the class of origin-symmetric convex bodies contained in B. Using 
this fact, an appropriate modification of the proof of [3], Theorem 4, of the 
lower bound in (25) can be made that shows there is a constant c > such 
that 

(51) H{t,Z 2 {B))>cr 1 / 2 , 

for sufficiently small t > 0. It follows that the exact entropy exponents for 
Z 2 (B) and )C 2 (B) are the same, namely, —1/2. For n > 3, however, the 
following theorem represents a dramatic improvement. 



Theorem 7.3. Let Z n (B) denote the space of origin- symmetric zonoids 
contained in the unit ball B in 1" , endowed with the Hausdorff metric. If 
n>3, then for all < t < 1/2 and any n > 0, 



(52) H(t,Z n (B)) = 0(t 



-2(n-l)/(n+2)-m 
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Proof. Let t > 0. Suppose that K is a zonoid in Z n {B). Clearly, there 
are an N = N(n,t) G N, depending only on n and t, and a zonotope Z such 
that 

(53) K C Z C (1 + t/2)K, 

where Z = Yli=i a i~ v i> v i]i f° r some < a < 1 and Vi G 5 n_1 , i = 1, . . . ,N. 

Let 5 be a i/(4iV)-net in [0, 1] and let U be a £/(4iV)-net in S" 1 " 1 . Let s be 
the closest point in S to a, let Ui be the closest point in U to i = 1, . . . , N, 
and let 

N 

(54) Z' = ^s[-itj,Ui]. 

i=l 

For each i = 1, . . . ,N , Li = a[— Vi, Vi] and Mj = s[— Ui, Ui] are origin-symmetric 
line segments whose Hausdorff distance apart is bounded by the distance be- 
tween the points avi and sitj. Using this, we obtain 

N N 

5(Z,Z') = \\hz ~ hz'\\oo < ^2\\hLi ~ hMiWoo < ll a ^ ~ SU i\\ 

i=l i=l 

N N ( t t \ t 

< ^2(\\avi - aui\\ + \\aui - sui\\) < ^1 — + 



i=l i=l 



\4N AN 2 



From this and (53), we obtain S(K,Z') < t. 

By Proposition 3.1, we can choose S and U so that \S\ = 0(N/t) and 
\U\ = 0((A^/t) n_1 ). With this choice, the number of zonotopes of the form 

(54) is 0((N/t) nN ). Therefore, the t-entropy of Z n (B) is 

(55) H(t,Z n (B)) = o(Nlog(^ 



. t 

Bourgain and Lindenstrauss [2] proved that, for < t < 1/2, one can take 

/ / 1 \ 2/5 

(56) N = N(3,t) = Oi t- 4 / 5 flog -J 

when n = 3 and 

(57) N = N(A,t) = o(t~ 1 (log^J 3/ ^ 

when n = 4. They also obtained a good bound for n > 5, but this was im- 
proved by Matousek [24], who obtained 

(58) N = N(n,t) = 0(t~ 2 ( n - 1 '>/( n+ V), 

for n > 5. Substituting (56), (57) and (58) into (55), we obtain (52). □ 
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Let e and t be positive numbers and let k £ N and Z G Z n be given. In 
accordance with earlier notation, let 

Gk(e, hz) = {h-L € G:\hz- h L \ k < e}, 

and let H{t,G k (e,h z )) = H(t,G k (e,h z ),\ ■ \ k ) be the t-entropy of G k (e,h z ) 
with respect to the pseudometric generated by | • \ k . 

Corollary 7.4. Let (ui) be a sequence in S"™" 1 such that (u*) is evenly 
spread and let Z be an origin-symmetric zonoid in M n with Z C RB for some 
R > 0. Ifn>3, then for any n > 0, there are constants te = ts(n, (ui),r]) and 
C% = C6(n,(ui),n) such that 

(59) H(t, G k (e, h z )) < <- i? 2 ^" 1 )/^ 2 ^ r 2(n-l)/(n+2)-^ 
for all keN, 0<e<R and0<t< Rt 6 . 

Proof. This follows from Theorem 7.3, exactly as Corollary 5.5 follows 
from Proposition 5.4. □ 

Lemma 3.3 guarantees the existence of sequences satisfying the hypothesis 
of the next theorem. 

Theorem 7.5. Let a > and let K be an origin- symmetric convex body 
in M. n such that K C RB , where K-n—i 

R n-i > 2 15 / 2 cj. Let ( Ui ) be a sequence 
of directions in S' n ~ 1 with A£ = 0(k~ 1 ^ n ~ 1 ^), and suppose that Z k is a cor- 
responding solution of (42). If n = 2, then, almost surely, there are constants 
C-j = C-j((ui)) and = Ni{a,R, (ui)) such that 

(60) S 2 {UK, Z k ) < CV 4/5 i? 1/5 A;- 2 / 5 , 

for k > Nj. If n = 3 or 4, there is a constant 70 = 70 (n) > such that if 
< 7 < 70, then, almost surely, there are constants C% = Cs(n, (nj),7) and 
N$ = Ns(cr,n, R, (ui),~/) such that 

(61) 5 2 (UK, Z k ) < C g(T ("+ 2 )/( 2 ™+ 1 )-^ J R(™- 1 ) 2 /(2n+l)+7 A .-(n+2)/(4n + 2) +7) 

for k > N 8 . 

Finally, ifn > 5, there are constants Cg = C$(n, (uj)) and Ng = Ng(o~, n, R, 
(ui)) such that 

(62) 5 2 (UK, Z k ) < C 9 R n - l k~ l ^ n - l \ 
for k > Ng. 



(64) a : 
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Proof. Let e = 2 15 / 2 a and 77 > 0. As K C ifcB, we have UK C « n _ii? n_1 B. 
Since < £0 < i^n-iR 71 " 1 , Corollary 5.5 (for n = 2, using £/ C Q) and Corol- 
lary 7.4 (for n > 3) with Z and -R replaced by UK and K n _\R n ~ l , respec- 
tively, yield 

(63) ff(t, fc (e, /UK)) < C 6 R^ a r a , 

for all fe G N and < t < Rt 6 , where 

1/2, ifn = 2, 

2(n- l)/(n + 2) +77, if n > 3. 

If 77 < 6/ (n + 2), then q < 2, so applying Corollary 4.2 with this a, to = -R*6) 
M 2 = CgJSfc -1 ) ' and £/ replaced by Q, we conclude that, almost surely, there 
are constants Co = co(a, ri, 77) and no = no(<r, ri, i?, (uj), 77) such that 

(65) |fc n * - ^J fe < C0j R(«- 1 )«/( 2 +«)A;- 1 /(2+ a ) ) 
for k>riQ. 

The dependence on cr is dealt with by the device used in proving Corol- 
lary 5.7. By using scaled measurements, 

Xyi = Xb K (ui) + XXi = \h U K{ui) + AXj = /i n(A i/ (n -i) K )( u i) + 

replacing K, R and a by A 1 ^™" 1 ^, A 1 /^™ - 1 'i2 and Act, respectively, and 
then setting A = 1/cr, we obtain from (65) the inequality 

(66) \h UK - h iu \ k < Cl a 2 '^ jR ("-i)«/(2+-) / ,-i/(2+ Q ) ) 

which holds, almost surely, for some c\ = 01(71,77) and k>riQ. 

By Lemma 3.3, we may apply Lemma 7.1, with K, L and R replaced by 
UK, Z k and R n ~ l , respectively, to obtain UK, Z k C SB for all k>N$, 
where 

(67) S = CZ\h UK -hz k \ k + 2K n ^ 1 R n - 1 . 

In Lemma 5.2 we make similar substitutions and replace the set {u\, . . . , u k } 
by {ul, . . . , u.2 k }, to conclude that 

S 2 (UK,Z k ) < (2ku } l) 1 l 2 (\h nK - h^\ k + 2A* k S), 

for all k > Nq. This, (66) and the fact that by Lemma 3.3 we have kuJ k = 0(1) 
imply that there are constants C = C'(n, (ui),rj) > and N' = N'(a,n,R, 
{ui),rf) > such that 

(68) 5 2 {UK, Z k ) < C'{a 2 l^ R (n-l)a/(2+a) k -l/(2+a) + Rn -l k -l/(n-l)^ 

for all k > N' . For n > 5 and large k, the second term dominates and (62) 
follows. For n < 4 and large k, the first term dominates; then (64) and (68) 
yield (60) for n = 2 and (61) for n = 3 and 4. □ 
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The next theorem gives rates of convergence for Algorithm NoisyBrightLSQ 
in terms of the Hausdorff metric. For n > 3, we omit the dependence on R 
because this is complicated by the use of Proposition 2.2; as we mentioned 
above, no particular effort was made to obtain optimal results in the estimate 
(4). 

Theorem 7.6. Let a > and let K be a convex body in M. n such that 
K C RB, where K n ^iR n ~ l > 2 15 / 2 <r. Let (ti$) be a sequence of directions in 
,S n_1 with A* k = 0(£;~ 1 / ( ' n ~ 1 )) , and suppose that Qfc is an output of 
Algorithm NoisyBrightLSQ as stated above. Lf n = 2, then, almost surely, 
there are constants C\q = Cio(<r, and N\q = N\q{u,R, (ui)) such that 

(69) 5(K,Q k )<C w R 7/15 k- A / 15 , 
fork>N 10 . 

If n > 3, suppose, in addition, that rB C K for some < r < R. For 
n = 3 or 4, there is a constant 71 = 71(71) > such that if < 7 < 71, then, 
almost surely, there are constants C\\ = Cii(a,n,r,R,(ui),-y) and N±i = 
Nn(o~, n, r, R, (ui), 7) such that 

(70) 8(K, Q k ) < C n fc- (n+2)/{n{n+4)(2n+1))+7 , 
for k > Nu ■ 

Ifn > 5 and 7 > 0, then, almost surely, there are constants C12 = Ci2(cr, ra, 
r, R, (v,i) , 7) and Ni2 = Ni2(a,n,r,R,(ui),^/) such that 

(71) S(K, Q k ) < C 12 fe- 2 /((n-l)«(n+4))+7 ) 
for k>N 12 . 

Proof. Suppose that n = 2. Then UK and HQk are rotations about 
the origin by tt/2 of 2K and 2Qk, respectively. Then (69) follows directly 
from (60) and (1). 

Now suppose that n > 3. We have sB C UK C tB, where s = K n _ir n ~ 1 
and t = Kn^iR 11 - 1 . Note that (61) (for n = 3 or 4), (62) (for n > 5) and 
(1) imply that, almost surely, there is a constant iV"i3 = Nis(a,n,r, R, (u^) 
such that (48) holds for all k > N13. As in the proof of Theorem 7.2, we can 
conclude that 

(72) r BcK,Q k cR B, 

for k > iVi3, where ro and i?o are given by (50). The desired results, (70) 
for 71 = 3 or 4 and (71) for n > 5, now follow from Proposition 2.2 (with 
L = Qk) and Theorem 7.5. □ 

The use of Proposition 2.2 in the previous theorem introduces a factor 
that worsens the convergence rates considerably. For example, when n = 3, 
we obtain a convergence rate of approximately A; -1 / 30 ! 
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8. Monte Carlo simulations. The theory of empirical processes that un- 
derlies our theoretical results suggests that the rates of convergence ob- 
tained in Corollary 5.7, for support function estimation with respect to the 
pseudonorm | • are suboptimal for n > 5 (cf. page 162 of [32]). However, 
for n < 4, we expect them to be optimal, and this should carry over to 
the (identical) rates for Algorithm NoisySupportLSQ with respect to the L2 
metric, given in Theorem 6.2, as well as to the rates obtained in connection 
with Algorithm BrightLSQ, given in Theorem 7.5. On the other hand, we 
cannot expect the rates given in Theorems 6.2 and 7.6 involving the Haus- 
dorff metric to be optimal, in view of the use of (1) (and, in the case of 
Theorem 7.6, the use of Proposition 2.2). 

Extensive Monte Carlo simulations were run. The simulations are re- 
stricted to the case n = 2, since there does not appear to be a fully sat- 
isfactory implementation of Algorithm NoisySupportLSQ in higher dimen- 
sions (see the remarks in Section 6) and our present implementation of 
Algorithm NoisyBrightLSQ is too slow to allow enough iterations (we hope 
to improve this in the near future). In each simulation, a polygon was re- 
constructed 1000 times from noisy measurements of its support function or 
brightness function, using our implementations of Algorithm NoisySupportLSQ 
or Algorithm NoisyBrightLSQ, respectively. We developed the computer 
programs with the help of Chris Eastman, Greg Richardson, Thomas Riehle 
and Chris Street (work done as Western Washington University undergrad- 
uates) and Amyn Poonawala (at UC Santa Cruz). 

Before describing the results of the simulations, we need to clarify the role 
of R and the assumption in the above theorems about its relation to the noise 
level a. For example, the inequality R > 2 15//2 <r is often assumed in order to 
prove that d(K,Pk) < Ca a R b f n (k), where d is the pseudometric | • |^, the 
L2 metric or the Hausdorff metric. To test the dependence on k or on a 
over any fixed range cro < a < a\, we can obviously choose R large enough 
so that K C RB and R > 2 15 / 2 <7i is satisfied. We claim that the condition 
R > 2 15 / 2 <7 also does not play any essential role in testing the dependence 
on R, and that we can view R as a scaling factor of K. To see this, suppose 
K, a and a range < Ao < A < Ai of scaling factors are given. Choose Rq 
large enough so that K C R B and A -R > 2 15 / 2 cr. Then XK C (XR )B and 
XRo > 2 15 / 2 o- for A > A . Replacing K and R in our theorems by XK and 
Aoi?o, respectively, we obtain 

d(XK,P(X) k ) < Ca a (XR ) b f n (k) = Ca a R b X b f n (k) = C'X b f n (k), 

where P(X) k is the output polytope for input XK and where C does not 
depend on A. Thus, the exponent for A is the same as that for R above, 
proving the claim. 

Two input polygons were used, the regular 11-gon and irregular 9-gon dis- 
played in Figure 1. Some results for the regular 11-gon are shown in Figure 2. 
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Each graph shows the results from 1000 iterations of Algorithm NoisySupportLSQ. 
The graphs are divided vertically into two groups of six graphs, correspond- 
ing to noise levels 0.1 and 1. In the left-hand column, the error (i.e., the 
distance between the input polygon and output polygon) is measured with 
the pseudonorm | • while in the middle and right-hand columns, the L2 
and Hausdorff distances, respectively, are used instead. Each graph shows 
a curve giving the average error over all 1000 iterations, and points plotted 
above the curve giving the maximum error over the 1000 iterations. In each 
group of six graphs the top row shows error against the scaling factor R 
varying from R = 0.2 to R = 6 in steps of 0.2, where the support function is 
always measured in the 35 directions at angles 0, 27r/35, 47r/35, . . . ,687r/35. 
The second row in each group of six graphs shows error against the number 
k of measurements [in directions at angles 0, 2n/k, &ir/k, . . . , 2(k — l)n/k] 
varying from 20 to 100 in steps of 5, with the scaling factor R fixed at 1. 

For each of the 12 graphs in Figure 2, we used standard software to fit 
a curve of the form CR b or Ck c (for error against R or k, resp.) to the 
points representing the averages over the 1000 iterations, and we repeated 
this for the points representing the maxima over the 1000 iterations. The 
corresponding values of b and c are shown in Table 1. 

The case n = 2 of Corollary 5.7 and Theorem 6.2 suggests that the ap- 
propriate values are 6 = 1/5 = 0.2 and c = —2/5 = —0.4 when errors are 
measured with | • |j. and the L2 metric, and b = 7/15 = 0.4666 . . . and c = 
—4/15 = —0.2666 . . . when errors are measured with the Hausdorff metric. Of 
course, these theorems apply only for sufficiently large values of k depending 
on both the noise level a and the scale factor R. 




Fig. 1. A regular 11-gon and irregular 9-gon. 
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Table 1 

Fit for average and maximum error against R and k (ll-gon) 





Error 




Average 






Maximum 






L 2 


Hausdorff 




Lz 


Hausdorff 


£7 = 0.1 


b 


0.2020 


0.2226 


0.3248 


0.1521 


0.1567 


0.2521 




c 


-0.4006 


-0.3593 


-0.3052 


-0.4415 


-0.4468 


-0.3262 


(7 = 1 


b 


0.1787 


0.1684 


0.2668 


0.2771 


0.2295 


0.1686 




c 


-0.4268 


-0.4202 


-0.3628 


-0.5338 


-0.5347 


-0.4316 



Despite the varying values in Table 1, we believe that the results of our 
Monte Carlo simulations are compatible with the expectations outlined in 
the first paragraph of this section, except perhaps in the case of Hausdorff 
error against scale. When the noise level is a = 0.1, the values given in 
Table 1 for the | • \k error, b = 0.2020 and c = —0.4006, for the average of the 
1000 iterations are in very close agreement with theory, and the agreement 
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I* 



Hausdorff 






Fig. 3. Error against a for the regular 11 -gon. 



is only slightly worse for the other metrics and at the high noise level a = 1, 
except for Hausdorff error against scale. 

Naturally, the results for the maximum of the 1000 iterations are more 
unreliable due to the stochastic nature of the simulations. However, a poor 
fit does not necessarily contradict Corollary 5.7 and Theorem 6.2 (note the 
words "almost surely" in the statements of these theorems), especially for 
high noise levels. Better fits can be expected for data representing 1 or 2 
standard deviations, for example, above the average for the 1000 iterations. 
For example, when a = 1, the data representing 2 standard deviations above 
the average gives c = —0.4505, —0.4479 and —0.3745 for the | • \k, L 2 and 
Hausdorff errors, respectively (compare the three numbers at the right of 
the bottom row in Table 1). 

In Figure 3 the three types of errors for the regular 11-gon are plotted 
against noise level a varying from a = 0.02 to a = 0.5 in steps of 0.02. 
Here the support function is always measured in the 35 directions at an- 
gles 0, 27r/35, 47r/35, . . . , 687r/35, and the polygon is unsealed (i.e., R = 1). 
As before, each graph shows a curve giving the average error over all 1000 
iterations, and points plotted above the curve giving the maximum error 
over the 1000 iterations. The exponents a for curves of best fit of the form 
Ca a are, for the average, a = 0.7894, 0.8038 and 0.7150 for the | • | fe , L 2 and 
Hausdorff errors, respectively. The corresponding exponents for the maxi- 
mum error are a = 0.9286, 0.9346 and 0.7593. These are in good agreement 
with the values a = 4/5 = 0.8 for the | • \t and L 2 errors given in Corol- 
lary 5.7 and Theorem 6.2. The less convincing agreement with the value 
a = 8/15 = 0.5333 . . . for the Hausdorff error given in Theorem 6.2 is not 
surprising, since the discrepancy between L 2 and Hausdorff errors that oc- 
curs via (1) is smaller for the regular 11-gon than for a general polygon. 

Simulations for the regular 11-gon at a low noise level, a = 0.01, as well 
as for the irregular 9-gon in Figure 1, were also compatible with theory. For 
the details, see [11], Section 8. 

Suppose that we attempt to reconstruct an origin-symmetric planar con- 
vex body K, first with Algorithm NoisyBrightLSQ, using k noisy bright- 
ness function measurements at angles 0,Tv/k, . . . , (k — l)7r//c, and then with 
Algorithm NoisySupportLSQ, using 2k noisy support function measurements 
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at angles 0,ir/k, . . . , (2k — l)ir/k. The two output polygons will, in general, 
be different, but apart from the noise, this is only because the two sets of 
measurements do not "match." Indeed, for any angle a € [0,27r), 

(73) h K (a±7r/2)=b K (a)/2, 

in view of the origin symmetry of K . In fact, there is a very close relationship 
between our implementations of Algorithms NoisySupportLSQ and 
NoisyBrightLSQ when n = 2. If we run Algorithm NoisyBrightLSQ with 
noisy brightness function values yt measured at angles ai, i = 1, . . . ,k, in 
the interval [0, 7r), our implementation will produce an origin-symmetric 
output polygon with outer normals among the directions a, ± tt/2, 
i = 1, . . . ,k; see [13]. Using this fact and (73), it is easy to prove that if 
we then run Algorithm NoisySupportLSQ using yi/2 as noisy support func- 
tion value at angle cti± ir/2, % = 1, . . . , k, the output polygon will also be 
Qk- Thus, very similar results can be expected from the two algorithms 
when n = 2 and K is origin symmetric, and we verified this by performing 
simulations of 1000 iterations of Algorithm NoisyBrightLSQ for a regular 
origin-symmetric 12-gon and an affinely regular origin-symmetric octagon. 
We omit the details, noting only that values of a and b indicated by the 
case n = 2 of Theorems 7.5 and 7.6 are the same as those above, and that 
the observed agreement was similar in all respects to that detailed above for 
Algorithm NoisySupportLSQ. 

9. Application to a stereological problem. In this section the conver- 
gence results above are used to obtain strong consistency of an estimator for 
the directional measure of a random collection of fibers. Details about the 
following notions can be found in Chapter 9 of [30]. A fiber is a C 1 curve 
of finite length, and a fiber process Y is a random element with values in 
the family of locally finite collections of fibers in R n . We assume that Y is 
stationary (the term homogeneous is also used), meaning that the distribu- 
tion of Y is translation invariant. Suppose that A is a Borel set in R n with 
V n (A) = 1 and E is an origin-symmetric Borel set in 5 n_1 . Let fi(E) be the 
mean total length of the union of all fiber points in A with a unit tangent 
vector in E. Due to the stationarity of Y , fJ,(E) is independent of A and so 
this definition gives rise to a unique even Borel measure fi in S" ra_1 called 
the directional measure of Y. We also assume that, almost surely, the fibers 
of Y do not all lie in parallel hyperplanes, so that // is not concentrated 
on a great sphere. The length density L = /j 1 (S n ~ 1 ) is the mean total length 
of fibers per unit volume. The probability measure fi/L, called the rose of 
directions, can be interpreted as the distribution of a unit tangent vector at 
a "typical" fiber point, and hence, can be used to quantify anisotropy of Y. 

In applications, the fiber process Y often cannot be observed directly, 
but only via its intersections with planes. Due to the stationarity, we can 
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restrict our considerations to hyperplanes containing the origin. For each 
u G 5 n_1 , let 7(1*) be the mean number of points in Fflw 1 per unit (n — 1)- 
dimensional volume. The function 7 is called the rose of intersections of Y. 
It is well known that 



for all u G S n ~ l . As h(u) = \u ■ v\, «£ S" 1-1 is the support function of the 
line segment [— v,v], (74) shows that 7 is the support function of a zonoid Z, 
called the associated zonoid or Steiner compact of Y. Minkowski's existence 
theorem implies that there is a convex body K with surface area measure 
2(i. As 



for all u G S n 1 [see, e.g., [28], equation (5.3.34)], we have hz(u) = r y(u) = 
huK(u), u G S n ~\ and so Z = UK. 

Since 7 (n) = (u) = b K {u) for u G and /x = (1/2)S(K, ■), the fol- 
lowing slightly modified version of Phase I of Algorithm NoisyBrightLSQ 
allows the reconstruction of an approximation /ij. to (i from noisy measure- 
ments of 7. 

Algorithm NoisyRoseLSQ. 

Input: Natural numbers n > 2 and fe; vectors it, G S n ~ l , z = 1, . . . , k, that 
span M n ; noisy measurements 



i = 1, . . . , k, of the rose of intersections 7 of an unknown stationary fiber 
process Y in W 1 , where the Xi's are independent A^(0,cr 2 ) random variables. 

Task: Construct a finitely supported measure (ik in 5 n_1 that approxi- 
mates the directional measure (i of Y. 

Action: Find a zonotope Z^ G Z n that solves the following least squares 
problem: 



(74) 




(75) 




(76) 



Ui = l(ui) +Xi 



k 



(77) min - M^)) 2 . 



i=i 



Calculate the finitely supported surface area measure S{Qk, •) of the origin- 
symmetric polytope Qfe satisfying 



Zfc = nQfc 



andset/i fc = (l/2)5(Q fc ,0. □ 
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As was remarked for Algorithm NoisyBrightLSQ after the statement of 
that algorithm, Zk can be assumed to be a sum of line segments, each parallel 
to a node corresponding to U = {u±, . . . ,?/*.}, and only the lengths of these 
line segments have to be determined. Applying the same observation leads to 
an output fik that is supported by the finite set of nodes corresponding to U. 
This implementation of Algorithm NoisyRoseLSQ was suggested previously 
by Mannle [23], who obtained the following result. 

Proposition 9.1. Let Y be a stationary fiber process in W l with direc- 
tional measure fi and let (ui) be a sequence in S"™" 1 such that (u*) is evenly 
spread. If fik is an output from Algorithm NoisyRoseLSQ as stated above, 
then, almost surely, (ik converges weakly to n, as k — > oo. 

Mannle [23] obtained Proposition 9.1 using local Kuhn-Tucker conditions 
for the solutions of a weighted least squares problem slightly more general 
than (77). However, the result follows immediately from Theorem 7.2 on 
observing that the map that takes K G IC n to S(K, •) is weakly continuous 
on fC n (see, e.g., [28], page 205). 

The remainder of this section is devoted to presenting a refinement of 
Proposition 9.1 that provides rates of convergence of the estimators. This 
requires the introduction of metrics on the cone of finite Borel measures in 
S n ~ l to quantify the deviation of the estimator from the true directional 
measure. Details for the following definitions in the case of probability mea- 
sures can be found in Section 11.3 of [7]; the extension to arbitrary (non- 
negative) measures is not difficult. 

Let n and v be finite Borel measures in S n ~ x . Define 



(78) di)(fj,, v) = sup 



fd{ji-v) 

S n-1 

n-l 



BL 



< 1 



where, for any real- valued function / on 5" , we define 

||/bL = ||/||oo + ||/||L and ||/|| £ =sup l/ y~ / ^ )l . 

It can be shown that g?d is a metric, sometimes called the Dudley metric 
(though he attributes its definition to Fortet and Mourier [9]) on the cone 
of finite Borel measures, inducing the weak topology. Now define 



(79) 
where 



d P (iJ,, v) = inf{e > : fi(F) < v(F e ) + e, 

u{F) < ii{F £ ) +e,F closed in 



tie S n 1 : inf \\u — v\\<£ 
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Then dp is also a metric, the Prohorov metric, that induces the weak topol- 
ogy. The Dudley and Prohorov metrics are related, as we show below in 
Lemma 9.5. 

The following proposition follows from a stability result of Hug and Schnei- 
der [17] that generalizes one step in the proof of the version of Proposition 2.2 
due to Bourgain and Lindenstrauss [1]. 

Proposition 9.2. Let K and L be origin- symmetric convex bodies in 
W 1 , such that 

r BcK,LcR B, 

for some < ro < i?o- If < b < 2/{n{n + 4)), there is a constant d = 
c'(b,n,ro,Ro) such that 

(80) d D (S(K, -),S(L, •)) < c'5 2 (UK, UL) b . 

Proof. We refer the reader to Theorem 5.1 of [17]. In that result, more 
general than the statement of our theorem, take /i = S(K,-) — S(L,-) and 
<&(it • v) = \u ■ v\, so that according to [17], equation (52), 

(T*(/*))(u) = V{K\u L ) - V(L\u L ) = h nK (u) - h nL (u). 

As is noted by Hug and Schneider [17], who assume throughout that n > 3, 
we may then take (3 = (n + 2)/2 in their Theorem 5.1. With these substitu- 
tions, our theorem for n > 3 follows immediately. 

When n = 2, Theorem 5.1 of [17] is still valid (and our theorem follows as 
before), but its proof requires an adjustment. One of the main steps is the 
approximation of a continuous function / by its Poisson integral 

1 f 1-r 2 

fr{U) = Vn-iiS™- 1 ) Jgn-i (l +r 2-2ru-v)^ f{v) ^' 

where < r < 1 is a parameter. The proof of Theorem 5.1 of [17] uses the 
estimate 

(81) ||/ - MU < 2 ra+1 ^~ 2 ^| ||/|U(l - rjlog-?-, 

V n -i{S n x ) 1-r 

for 1/4 < r < 1, from Lemma 5.5.8 of [15], where the proof applies only when 
n > 3. However, when n = 2 it can be shown that 

(82) ||/ - MU < - r) log 

7r 1 — r 

for 1/4 < r < 1. Although this estimate is slightly weaker than (81), it is 
sufficient to prove Theorem 5.1 of [17] for n = 2. For a proof of (82), see 
the Appendix of [11]. □ 

Let T> denote the set of degenerate finite Borel measures in S" 1-1 , that is, 
those whose support is contained in a great sphere. 
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Lemma 9.3. Let fi be a finite Borel measure in 5' n ~ 1 and let 

(83) d D (fi,T>) = inf dv(fj,,v). 

Then the infimum is attained and the mapping /ii— > di){^,T>) is weakly con- 
tinuous. Consequently, the support of fj, is not contained in any great sphere 
if and only if d^{ii,T>) > 0. 

PROOF. For a > 0, let 

V a = {v£V:v{S n ~ 1 ) <2a}. 
If denotes the zero measure, we have 

d D ( t i,V)<d D (fi,0) = n(S n ~ 1 ). 
Therefore, if a > ^(S*™ -1 ), then 

(84) dB(^,T>)= inf cfo(/U,^)= inf (i D (/i,^), 

where the last equality comes from substituting / = 1 in the definition (78) 
of dj)(ij,, v). It is easy to see that T> is weakly closed and, hence, T> a is weakly 
compact, so the last infimum in (84) is attained. 

Let (//fc) be a sequence of finite Borel measures in S' ri_1 converging to \i. 
Choose a so that Hk{S n ~ l ) < a for all k. We know that there are measures 
v G T> a and v k G D a , k = 1, 2, . . . , such that 

d D (fj,,V) =d- D {p, 1 u) and d D (fi k , T>) = d D (fi k , u k ), 

for k = 1,2 ... . The weak compactness of T> a implies that a subsequence of 
{uk) converges to a measure v G 2? a . Then 

dB(fJ.,T>) < d D (fj,,D) 

= lim inf d D (^fc,^fc) 

fc-^oo 

= lim inf cfo (/*fc , D) 
k— >oo 

< lim sup dD(^fc,^>) 

fc— »oo 

< lim sup dj)(fik,v) 

fc^oo 

= d D (fj,,v) =d D (fJ.,'D). 

Therefore, 

lim d D (/ifc,£>) = d D (n,V), 

fc^oo 

as required. □ 
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The following refinement of Proposition 9.1 is phrased in terms of the 
Dudley metric. For n > 3, the extra condition that d < d^(fj,,T>) for some 
d > is needed. It is a natural analog of the condition that rB C K for some 
r > in earlier results, such as Theorem 7.6. Lemma 9.3 implies that such 
a lower bound d > always exists due to our general assumption that the 
directional measure \x is not degenerate. 

Theorem 9.4. Let a > 0. Let Y be a stationary fiber process in W 1 with 
directional measure fi and length density L = Let (ui) be a sequence 

of directions in 5 n_1 with A£ = 0{k~ l ^ n ~ 1 ^) and let fik be an output from 
Algorithm NoisyRoseLSQ as stated above. 

Ifn = 2 and (3 > 0, then, almost surely, there are constants C14 = Cn{a, L, 
(ui),j3) and Ni4 = Ni4(o~,L,(ui),(3) such that 

(85) d B (v,fi k )<C u k- 2 / 15+f3 , 
fork>N u . 

For n>3, let < d < dj)(fj,,T>). If n = 3 or 4 and (3 > 0, then, almost 
surely, there are constants C15 = 615(0", n, L, d, (ui),f3) and iVis = Ni^(a, n, L, 
d, (ui),f3) such that 

(86) cfofo/W < C 15 ^(" +2 )/«" +4 )( 2 " +1 ))^, 
fork>N 15 . 

Finally, ifn > 5 and (3 > 0, there are constants C±q = C\Q(a, n, L, d, (ui),f3) 
and N\q = NiQ(a,n,L,d,(ui),(3) such that 

(87) d D (^,/i fc )<^6^ 2/{(n - 1){n+4))+/3 , 
/or£;>iVi 6 . 

Proof. Let K and Qk be the origin-symmetric convex bodies with sur- 
face area measures 2fi and 2fik, respectively, and recall that = HQk- 
Suppose that n = 2. According to [28], pages 290-291, the mean width 

w(K) = — [ hxiu) du 

of K satisfies ttw(K) = S(K, S 1 ) = L. Since K = —K, for each x G K, 
[—x, x] C K and so 

4 _ _ 1_ 

— ||x|| = w{[— x,x\) < w(K) = —L. 

7T 7T 

It follows that K C {L/A)B. By the case n = 2 of Theorem 7.5, with 
R = max{L/4, (2 15 / 2 o7«n-i) 1/(n_1) }, 
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almost surely, there are constants Cyj = Cn(a, L, (ui)) and Nn = Nn(cr, L, (ui)) 
such that 

5 2 (nK,UQ k ) = S 2 {UK, Z k ) < C 17 k~ 2 / 5 , 

for all k > Nn. Inequality (80) with L = Qk now implies (85). 

Suppose that n > 3 and let < d < g?d(^> which is possible by Lemma 9.3. 
Let M = Ai(L,d) be the set of all finite Borel measures v in 5 n_1 such 
that v{S n ~ l ) < L and dv(v,T>) > d. Then n G M and M is weakly com- 
pact by Lemma 9.3. Using the equicontinuity of the family {f u :u G 5 n_1 } 
of functions defined by f u (v) = \u • v\ for v G 5 n_1 , we see that the map 
T : S^ 1 x M M defined by 

T(u,i>)= / |ti • u| di/(u) 

is continuous. Therefore, T attains its minimum r = r(n, L, d) at some point 
(no, vo) in the compact set S 1 ™ -1 x .M. Note that 

r = T(u Q , uq) = \u Q - v\ du (v) > 0, 

JS"- 1 

as uq is not degenerate. Then T(u,fi) > r for all u G S"'™ -1 , so by (75) and 
the fact that S(K, •) = 2u, we have 

huK(u) = / \u ■ v\ dfi(v) > r, 

for all u G <S n_1 . Therefore, C UK. On the other hand, (75) also implies 
hnK(u) < L = R. Summarizing, we have shown that there are constants 
< r < R, depending only on n, L and d, such that 

rB C UK C RB. 

As in the proof of Theorem 7.2, we can conclude 

r B CKC R B, 

with positive constants tq = ro(n,d,R) and Rq = Ro(n,d,R). Theorem 7.5 
can now be applied with 

R = max{i? , (2 15 / V«n-i) 1/(n_1) }• 
Inequality (80) with L = Q k then yields (86) and (87). □ 

To obtain a version of Theorem 9.4 in terms of the Prohorov metric, the 
following lemma is useful. 

Lemma 9.5. Let fi and v be finite Borel measures in S"™" 1 with tjiq = 
f i(S n ~ 1 )^0. IfdD(n,v)<l, then 

dp(n,v) < {l + v / 3 + m )d D (fi,iy) 1 / 2 . 
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Proof. We may assume that uq = v{S n ~ l ) / and let fit = /j/mo and 
v\ = v/riQ. For s,t > 0, the definition (79) of dp implies that 

dp (su, tu) = inf {e > : su(F) - tv(F £ ) < e, tv(F) - su(F £ ) < e, 

F closed in 

< inf{e > : su{F £ ) - tv(F £ ) < e, tu(F £ ) - sv{F £ ) < e, 

F closed in S"" 1 } 

< no\s — 1\, 

while the definition (78) of dp, (with / = 1) yields 

dp>{n,i>) > \m - n |. 

Therefore, 

dp(n,v) < d P (fi, (m /n )v) + dp((m /n )v,v) 
(88) < dp(m fii,m ui) +n \m /n - l\ 

< dp (m /ii , m vi) + dp, (/i, v) . 

Let < e < dp(mo/Ui, mo^i). By (79), there is a closed set F in S 1 ™" 1 such 
that 

/i 1 (F)>^ 1 (F e ) + — or v 1 {F)>ii 1 {F £ ) + — . 

to to 

Setting a = e/mo and (5 = e in Proposition 3 of [6], we obtain 

9 

e <d D (/Ui,^i). 



to (2 + e 

By (79) again, we have dp(/ii,z/i) < 1 and 

to 



dp(TO /xi,TO ^i) =inf|e > 0:/ii(F) < ^(F 5 ) + 

(F) <u 1 (F £ ) + —,F closed in S"" 1 } . 

to J 



Therefore, if too < 1, we have 

dp(m Hi,m vi) < d P ((J,i,vx) < 1, 
while, if too > 1, then 

dp(?n /ii,TO ^i) 

= TO O inf{e>0:Ati( J F)<z/i(F moE )+e, 

vi{F) < fii{F ma£ ) + e,F closed in S^ 1 } 
< mQdp(m,vi) < toq . 
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Thus, for any mo > 0, we have e < dp(mo/^i, mo^i) < 1 + m,Q. Substitution 
into (89) yields 

2 

Zr- r£ 2 <d D (ni,^l). 

m (3 + m ) 

As e < (ip(mo^i, mo^i) was arbitrary, we conclude that 

2 2 

— -fi P (?n /ii,m ^i) <d D (Ati,^i) 

m (3 + m ) 

< d D (fj,/m ,u/m ) + d D (v/m ,v/n ) 

2 

< — d D (jU,l/). 

Substituting this into (88), and using the hypothesis dr>(fi, v) < 1, we obtain 
the desired inequality. □ 

With Lemma 9.5 in hand, the estimates of Theorem 9.4 can be converted 
to the Prohorov metric. Since this is routine, we shall only give one example. 
By Lemma 9.5 and (86), under the hypotheses of Theorem 9.4 with n = 3, 
for all 7 > 0, almost surely, there are constants C\% = Cis(cr,R, (ui),j) and 
iVig = Nis(cr, R, (ui), 7) such that 

dp(M,Afc)<Ci8AT 5 / 98+7 ; 

for all k > Nig. Thus, the exponent when n = 3 is approximately —1/20. 

We close this section with a comment on the assumption in (76) that the 
errors are normally distributed. In applications, the measurements yi come 
from counting intersection points, so they are integer random variables. If 
L is large, our assumption is appropriate. Otherwise, a model that allows 
only integer values for yi could be more apt. For example, if Y is a Poisson 
line process (one of the most common models in stochastic geometry), then 
the number yi of intersection points of its fibers with a unit window in u 1 - 
is Poisson distributed with mean i = l, . . . ,k. Under this assumption 

on the distribution, the maximum likelihood problem no longer corresponds 
to a quadratic program. Nevertheless, its solution is a strongly consistent 
estimator for /i (see [20] ) , and the tools provided by van de Geer [32] would 
still allow results giving rates of convergence. 
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